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In this paper we ask: Is it necessary or desirable that a specialized organization 
whether one needs to be established or already exists -be the focal point 
of materials for computer-administered instruction (CAI) m higher education. The t.- 

ative answer is based on two premises: _ to 

(1) Currently, the time a university professor spends m learning how to 

interact with the computer and to take advantage of its J" 

materials to be administered at a terminal, usually comes about as ^ 

teaching requirements and his administrative duties. Thus, it is a part-time, secoi d y 

effort that he can give to the problem of material construction. romure- 

(2) The very nature of using computer capabilities involves a to ally comprc 

hensive and new look at the world of education as a system if we are to fully utilize this 

electronic ^devme.^ expertise required are indeed multidisciplinary. Furthermore, a special- 
ized organization with the necessary disciplines available, permits a perspective muc^ 
broader in scope and much more useful than the narrow view that may result when a 
subject-matter Scholar himself attempts to develop these materials or when he works 
with a group, such as a publisher, having a commercial interest in turning out a product 
for profTt. I believe the profit-oriented company is inappropriate to the task because its 
very nature involves it in a conflict of private versus public interest. 

^ Nonprofit research and development organizations do not have a particular vested 

interest, and some have had a liistory (nearly 20 years in HumRRO s ^ 
the instructional development for one user by means of helping the user to that 

1o teach is eouallv important with how to teach it. , « i j 

The concept and techniques of task analysis had its roots in and for decades 
been used effectively by, industrial and military organizations. Perhaps in this 
hXS ori^n lies at least a partial reason for the lag in adoption of the concept by the 
educational establishment. But with the term, “programed instruction this sam^^^ 
neering process-the careful determination of objectives development oi ^ 

those objectives, and successive try-out of materials until students learn from them has 
becomrmore acceptable. This engineering of the design of instructional systems for 
training has also benefitted from complementary strategies developed to improve the 
orgSti^n of the materials for presentation (Shoemaker, 1) For 
instructional materials in a functionally outlined context to ^ ^ 

microstructure as they are eventually to be performed m the f 
context has been quite beneficial. It also serves to screen irrelevant subject matter trom 
courses ’of instruction. In like manner, an analysis of the situations our students '^Ul face 
after they leave college and begin working, enables us to define the performances they 

must develop while students. , . , t-, n a t? riiricini and his 

The techniques of computerized job analysis which Dr. Raymon E. 

associates at the Personnel Research Laboratory, Air Force Systems Command^, Lack 
Air Force Base, Texas, have developed (Morsh, 2; Archer, Hiding and 
Morsh, Giorgia, and Madden, 5) can determine with considerable precision 
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commonly porformod tasks. ThesG tochniques can also cluster position descriptions into 
job types, and can determine how jobs differ when occupied by people of differing 
experience. These procedures have been developed by organizations of specialists outside 
educational institutions. However, the detailed procedures are all available for determining 
the demands for job-oriented higher education (Smith, 6), as are methods for specifying 
objectives precisely (Mager, 7; Ammermam and Melching, 8). With liberal arts courses, 
similar techniques can be applied (Smith, 6), although with less precision. 

The effort to develop objectives by looking outside educational institutions can lead 
to revolutionary changes in instruction. HumRRO research cites instances in which 
instruction has been shortened by half and then has yielded higher levels of proficiency 
as compared to a standard course. The keys have been (a) analysis of required job 
behavior and the learning tasks involved, (b) appropriate course design, and (c) improved 
organization of instructional materials based on diagnostic evaluation and repeated rede- 
sign to achieve desired effectiveness and efficiency. 

Both the what and the how aspects of instruction become even more important 
because of expense, complexity, and potential of the system involved when a computer is 
to be used in the instructional loop. One of the most pressing needs in the field of 
instructional development involving the use of the computer (whether it be drill-and- 
practice use or for other adjunctive uses, including tutorial) is a commonly accepted basis 
for determining costs. Preliminary experiences at various educational institutions 
(Bunderson, 9) clearly indicate the wide variety in production costs per hour of CAI 
instruction. These figures sometimes are as much as three to four times greater from one 
installation to another and at least some of the variation stems from differences in the 
complexity of the materials produced, use of revision costs in the analysis, inclusion of 
evaluation, and inclusion or exclusion of development costs for languages, systems, and 
authoring techniques. The director of a leading university-based CAI laboratory made this 
statement recently : 

“Based on the experience gained on these and other projects, we see how 
many costly aspects of development could be reduced by the application of 
better management, design, and production techniques and better CAI lan- 
guages and systems. There are certain irreducible human costs for management, 
authoring, and evaluation-revision which cannot be automated, however, and 
for which there appear to be no dramatic shortcuts.” (Bunderson, 9) 

The question concerning tho role of the computer in producing materials can be 
asked in another way: Is it desirable to progress in tlr; field of instructional development 
by an approach that is basically a trial-and-error, small-scale attempt to incorporate the 
computer within the current folklore of instructional development? Or will we recognize 
the need to fully utilize the capabilities of the computer within a changing environment 
of instructional development and administration? If the latter is accepted, the specialized 
organization is a desirable candidate. The investment will be much greater in dollar 
resources required and in personnel, but the “payoff” can be much, much greater in 
terms of the development of a new educational system. 

Why is the specialized organization needed? For one reason, the talents required are 
not present in any given university department. For another, as indicated above, talents 
that do exist in multidisciplines to attack the problems of developing material require a 
full-time effort. Whether a specialized organization handles the development of instruc- 
tional materials, or whether an already existing structure is used, nevertheless the 
full-time talents of subject-matter scholars, behavioral scientists, computer science special- 
ists, and hardware experts are required (Seidel and Kopstein, ^). Moreover, existing 
reward structures in universities do not support repetitive product improvement of course 
materials (e.g., “publish or perish” requirements, departmental dogma). 
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A summary of the obstacles found in one university installation when an attempt 
was being made to introduce some CAI materials for needed prerequisite skills lists the 

following. ^ cost-effective, service-oriented terminal facility. 

2. The problem of “grafting on” an individualized, adjunct course to the 

lock-sten tightly scheduled course structure of universities. 

3 The lack of fundamental interest and incentive of teaching assistants and 
other feculty in meeting the basic needs of freshman students.” (Bunderson, 9) 

These difficulties may arise because the departmental and disciplinary structures do n 
^end crossing these lines to promote inter-disciplinary collaboration. Finally, 

even i s^crhiterest could be created, there would be no interest in achieving compatibil- 
ftv o t^e coCute materials with computer inscallations at other universi ies. The 

lack of hitereTln compatibility-a crucial but widely ignored P^oblem-derives from he 
lack of incentives for widespread dissemination of the instructional materials. s 
for the potential receiving institution as well as for the sender. 

The CAI development effort at HumRRO has made us intensely aware 
for and the current l^k of, compatibility among existing CAI installations. This concerns 
us because the rewLds of a nonprofit Institution are continued acceptance and use of the 
"suits orr^earch and development that is well done not only for a particular sponsor, 

but also tor general use by, and acceptance tor, the public good 

The next topic: What are the resources required in order to accompli g 

instructional development in the use ot the computer? Many people now thmk ha 
computers are becoming very inexpensive and that one can be purchased or 
ot a^ tew thousand dollars. This may be possible and may indicate the ^ 

etficient development ot electronic technology. However, P 

Larlv developed to that point (Seidel, 11, 12,). Let me say here that I thoroughly agree 
with toe value ot having a creative faculty member, using a system ot trial-^d-error, and 
X havint had t ee contact with the computer and a terminal, perhaps discovenng an 
toovaUve way to teach something in his field. The creative graduate studen can 
contribute in the same way. Such serendipitous findings can be of ® , 

developing the technology. However, they do not provide a substitute for methodolo^c 
development of a pracHcal technology ot instruction, nor tor the massive task of 

nrpnarine volumes of good quality instructional content. , , ^ 

The issue is serendipity versus professional reliability and full-scale, long-term c 
mitmint rns uct on^ design and development. The teadier-scholar in the university or 
XTcirnot be counted upon to function as a full-time instructional designer; instruc- 
tionJ design can be best accomplished in an organizational structure established tor th 
nZosr «so the individual teacher-scholar is no substitute tor an interdisciplma^ 
Ztessional team with competence in the psychology ot learning, the mathematics o 
Ldefs and their optimization, intormation science, technical writing, and visual 

presentatioUt to perceive the protit-oriented company as an appropriate structure tor 
such a Lroment eftort because it is structured to serve the stockholder, gam annual 
tecle and UnUke the university, the commercial publisher is intensely 

interested in widLpread dissemination ot materials produced by him and *mr 
nrSoneed Z so he has to pay attention to compatibility. However, the survival ot the 
pubSer d^;nds^^^^ a frequency of profit over loss. It one looks at experience ^ 
programed instruction, one finds a reluctance on the part f 

inv^it in costlv cyclical or long-term product developments. I doubt whether, at presen , 
one can buy very many commercially published instructional programs tor which ade- 
auLe peSmSie data are available and which have been trequently revised and 
rpmveT“s ot diagnostic indications trom such data. It is reasonable to assume 
that CAI will follow the pattern of programed instruction. 
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Unlike the profit-oriented company, the nonprofit organization has no vested corpo- 
rate interest in product sales. The nonprofit organization works to solve problems of its 
sponsors and science and society at large. Thus, it is most likely to facilitate mass 
dissemination of the materials to many users. In making the case for the nonprofit 
developer of CAI material, I cite again HumRRO experience with users of instruction. 
HumRRO teams have dealt with the traditional subject-matter experts, explaining in great 
detail and repeatedly the value of stipulating one’s objectives not only in behavioral 
terms, but in terms relevant to the context of the job that the student was to enter after 
training. All of the HumR,RO research products are documented and available to the 
public (HumRRO Bibliography of Publications, ^). For the moment let us put aside all 
reservations concerning the similarities and dissimilarities between education and training. 
The point at issue is that while teachers today, as well as trainers, have become aware in 
most instances of the value of stating behavioral objectives, they have not done this in 
isolation. Furthermore, although this awareness may exist in the field of education, there 
is often a failure to take advantage of the knowledge that what to teach and how to 
teach are equally important. 

An interesting illustration is the large-scale study in Texarkana, Ark., where both the 
what to teach and the how to to teach are fantastically different from what was known 
to be the vogue or the customary practice. When it was discovered that incentives used 
for teachers and students were not the normal or traditional ones, the accepted way of 
rewarding, providing reward structure for students and teachers alike, many of the 
traditionalists became upset. But the point is that it took an outside organization 
specializing in the development of instructional materials to propose these radical ideas, 
to view the situation from a different point of view than the field of education and the 
board of education and its traditionalists had viewed it. Some of the problems publicized 
recently may also illustrate the difficulties when a profit motive is introduced. One 
wonders whether need for profit may be coloring either the user’s perspective and/or that 
of the developer. The case applies well to the use of the computer for instructional 
purposes whether one is going to use it for drill-and-practice mode, problem solving, 
simulation, or tutorial CAI. 

A final point I wish to emphasize is the need for adequate evaluation whenever 
instructional materials are developed. Here again it seems that the structure of educa- 
tional institutions today is geared more toward a classic grading system, based upon 
normative approaches to measurement, and upon extrinsic and perhaps irrelevant indica- 
tors of achievement. As, Bs, Cs, and so forth, are not readily translatable into degree of 
achievement of specified objectives. Furthermore, such grading systems do not take into 
account the need for more appropriate diagnosis of individual students and the distinct 
possibility that all students should achieve 100% and receive As in a given course. 
Changes are beginning to take place, however, in limited occurrences. Some universities 
and colleges, and some professors within a small number of colleges, are becoming aware 
of the necessities for objectives, diagnosis, evaluation, and revision of course materials to 
enable all students to achieve to the maximum. On the other hand, within existing 
specialized, instructional development organizations there is a large capability and experi- 
ence in this type of evaluation. 

One possible way to accomplish this type of evaluation, and perhaps a reasonable 
model to use for a different type of specialized nonprofit organization, acceptable to 
policy makers and educators alike, would be the establishment of experimental stations, 
such as proposed recently (Rothkopf, 14 ) before the Subcommittee on Education (also, 
Bunderson, 9). Analogy is made to agricultural experimental stations established to 
provide for planned analysis, evaluation, and improvement in understanding in that area. 
At the present time, education can be viewed as a high labor intensive area with a low 
yield. Making instructional practices and activities explicit, providing for the use of the 
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computer within suclr experimental stations to aid in Hre 

transactions, might well be the means for long-term mvolvement of the computer 
production evaluation, and dissemination of improved instruction. Drahovf r 

At this point, it i; appropriate to quote from my HumRRO col.ea^e Dr. Roberta 
Smith, Jr. His admonition to all of us who are engaged in CAI work is to avoid DA 

parochialism. 

“My casual impression which I hope is wrong, is that people \vorldng in 
TAI have a tendency to get so involved with their terminals, interfaces, 
operating systems, and other hardware and software problems, that they forp 
th^t there is a great deal of sound research in psychology and educadon which 
“a be^ng of the engineering of instruction. I have just been reviewing this 

literature, and I am very impressed with it. 

In other words, in our enthusiasm for developing better instruction, we may tend to get 
fpp cloqp to the computer to see beyond the peripherals. 

the clLirnrihorcr'of CAVma\edL" 

o^'^pefat^TTo^ tTlnst^u^onal product 

THPrcial Dublishing houses have such interests, their profit mak g ^ffp- 

=' "•= B 

caSie"^to Zdop' CM Taterial^ we think that our problems today are rather 

unique and novel, let me conclude with the following. 

“There is nothing more difficult to take in hand more perilous to 
conduct, or more uncertain in its success, than to a e e 
introduction of a new order of things. 

This, of course, was stated by that well-known cducator-Machiavelli. 
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